Evaluating automatic medical concepts associations with human judgments
نویسندگان
چکیده
This paper evaluates the associations of a subset of concepts extracted by VCGS (Vocabulary Cluster Generating System), a concept extraction and association tool, based on 6000 titles and abstracts downloaded from EBSCOhost Health Source – Consumer Edition database, against associations decided by 30 participants. The results show that after incorporating LSA (Latent Semantic Analysis) technique, the VCGS system establishes term associations that are not significantly different from users.
منابع مشابه
ORANGE: a Method for Evaluating Automatic Evaluation Metrics for Machine Translation
Comparisons of automatic evaluation metrics for machine translation are usually conducted on corpus level using correlation statistics such as Pearson’s product moment correlation coefficient or Spearman’s rank order correlation coefficient between human scores and automatic scores. However, such comparisons rely on human judgments of translation qualities such as adequacy and fluency. Unfortun...
متن کاملAutomatic and Controlled Semantic Retrieval: TMS Reveals Distinct Contributions of Posterior Middle Temporal Gyrus and Angular Gyrus.
UNLABELLED Semantic retrieval involves both (1) automatic spreading activation between highly related concepts and (2) executive control processes that tailor this activation to suit the current context or goals. Two structures in left temporoparietal cortex, angular gyrus (AG) and posterior middle temporal gyrus (pMTG), are thought to be crucial to semantic retrieval and are often recruited to...
متن کاملThe Correlation of Machine Translation Evaluation Metrics with Human Judgement on Persian Language
Machine Translation Evaluation Metrics (MTEMs) are the central core of Machine Translation (MT) engines as they are developed based on frequent evaluation. Although MTEMs are widespread today, their validity and quality for many languages is still under question. The aim of this research study was to examine the validity and assess the quality of MTEMs from Lexical Similarity set on machine tra...
متن کاملComparing Automatic and Human Evaluation of NLG Systems
We consider the evaluation problem in Natural Language Generation (NLG) and present results for evaluating several NLG systems with similar functionality, including a knowledge-based generator and several statistical systems. We compare evaluation results for these systems by human domain experts, human non-experts, and several automatic evaluation metrics, including NIST, BLEU, and ROUGE. We f...
متن کاملمبانی انسانشناختی طب سنتی- ایرانی با تأکید بر آرا ابن سینا و مقایسه آن با طب مدرن
From the view of Islamic philosophers, especially Ibn Sina, philosophy is accountable for providing the basis for other sciences. According to Ibn Sina, medicine is one of the aspects of natural philosophy the concepts and judgments of which originate from natural philosophy. In his medical textbooks, Ibn Sina draws on philosophical theories and views, one of which is a discussion of humanity a...
متن کامل